GALACTICA is a large language model trained on a large-scale scientific corpus and designed specifically for scientific tasks, including citation prediction, scientific question answering, mathematical reasoning, etc.
Large Language Model
Transformers